Aiming at the problem that virtual-real registered accuracy and real-time performance are influenced by image texture and uneven illumination in Augmented Reality (AR), a method based on improved ORB (Oriented FAST (Features from Accelerated Segment Test) and Rotated BRIEF (Binary Robust Independent Elementary Features)) algorithm was proposed to solve it. The method firstly optimized the dense region of image feature points by setting the number and distance threshold of it and used parallel algorithm to reserve N points of greater eigenvalue; Then, the method adopted discrete difference feature to enhance the stability of uneven illumination changes and combined the improved ORB with BOF (Bag-of-Features) model to realize quick retrieval of Benchmark image. Finally, it realized the virtual-real registration by using the homographics between images. Comparative experiments among the proposed method, original ORB, Scale Invariant Feature Transform (SIFT) and Speed Up Robust Features (SURF) algorithms were performed from the aspects of accuracy and efficiency, and the proposed method reduced the registration time to about 40% and reached the accuracy more than 95%. The experimental results show that the proposed method can get a better real-time performance and higher accuracy in different texture and uneven illumination.